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(57) Abstract 

A field synchronization system for asynchronous video signals, comprises a video display synchronized with a first vide 
signal having a first line rate component and a first field rate component. A second video signal having a second line rate compc 
nent is first stored in a field memory, having synchronous write and read ports. The second video signal is thereafter speeded u 
in a multiple line memory (354) having asynchronous write and read ports and independently resettable write and read pointer: 
The second video signal may be subsampled, written and read into and out of the field memory respectively and written into th 
multiple line memory, all synchronously with the second line rate component. The second video signal is read out of the multipi 
line memory (354) synchronously with the first line rate component. The write pointer is reset by a circuit (320) which samples th 
first field rate component with the second line rate component. The read pointer is reset by a circuit which samples the first fiel* 
rate component with the first line rate component. 
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FIELD SYNCHRONIZATION SYSTEM 
WITH WRITE/READ POINTER CONTROL 

The invention relates to the field of televisions having 
multiple picture displays for asynchronous video signals, and in 
particular, to such televisions having a wide display format ratio 
screen. Most televisions today have a format display ratio, 
horizontal width to vertical height, of 4:3. A wide format display 
ratio corresponds more closely to the display format ratio of 
movies, for example 16:9. The invention is applicable to both direct 
view televisions and projection televisions. 

Televisions having a format display ratio of 4:3, often referred 
to as 4 X 3, are limited in the ways that single and multiple video 
signal sources can be displayed. Television signal transmissions of 
commercial broadcasters, except for experimental material, are 
broadcast with a 4 X 3 format display ratio. Many viewers find the 
4X3 display format less pleasing than the wider format display 
ratio associated with the movies. Televisions with a wide format 
display ratio provide not only a more pleasing display, but are 
capable of displaying wide display format signal sources in a 
corresponding wide display format. Movies "look" like movies, not 
cropped or distorted versions thereof. The video source need not be 
cropped, either when converted from film to video, for example with 
a teiecine device, or by processors in the television. 

Televisions with a wide display format ratio are also suited to 
a wide variety of displays for both conventional and wide display 
format signals, as well as combinations thereof in multiple picture 
displays. However, the use of a wide display ratio screen entails 
numerous problems. Changing the display format ratios of multiple 
signal sources, developing consistent timing signals from 
asynchronous but simultaneously displayed sources, switching 
between multiple sources to generate multiple picture displays, and 
providing high resoiu-ion pictures from compressed data signals are 
general categories of such problems. Such problems are solved in a 
wide screen television according to this invention. A wide screen 
television according to the various aspects of this invention is 
capable of providing high resolution, single and multiple picture 
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displays, from single and multiple asynchronous sources havinq 
s.m.lar or different format ratios, and with selectable display 
format ratios. H y 

When an auxiliary picture is a small inset, various artifacts 

HclZw 56 SynC ! 1r0nization with th ° "*•> Signal are toierable. 
However, for some formats particularly suited for a wide screen 
telev.s.on, such as two side by side pictures of equal size, such 
imprecsion and artifacts cannot be tolerated. The large size of the 
auxiliary picture can make such artifacts painfully obvious 

nZZ « ? 8 Vide ° diSPi3y de,leC,i0n s * stem *» Wilt- 
p.cture displays .. synchronized with the main video signal The 

auxiliary video signal must be verticaHy synchronized with the main 

v,deo signal and the video display. ,n a relatively inexpensive 

system, the auxiliary video signal can be delayed by a fraction of a 

n a X T 3 fi6ld rnem ° ry - ^ the " S " eeded a line memory. 

In a relatively expense and sophisticated system, such as is 

commonly used in broadcast quality studios, a four field 
synchronization system utilizes four dual port asynchronous field 
memones. Asynchronous memories, that is, those having 
independent write and read clock ports, are generally more 
expensive than synchronous memories. 

According to inventive arrangements described herein a 

m!ZV f J e,d rf Synchr0ni2atton 03(1 ^ achieved which substantially 
matches the performance of a four field system, but utilizes only a 
s.ngle synchronous video RAM as a field memory and a single 

f, Sy h Ch n=o S firSt ,ir$t ° Ut (F ' F0) mult 'P le line ^rnory ^vice 
If the FIFO is a five line memory, the following artifacts can be 

encountered: (1) Two frame line shifts and 1 field line shift will 

occur each time the two signals precess through a video frame: and, 

(2) The aux,l ia ry channel video gets scrambled at the bottom of the 

picture whenever the precession rate between the main and auxiliary 

signals ,f greater than two lines per frame. This precession rate 

has been found not likely to occur in the consumer electronics 

environment. The cost saving over a four field system is 

approximately 4:1, without incurring any significant sacrifice in 

performance. The size of the FIFO is related to .the minimum line 
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storage capacity thought to be reasonably necessary to avoid 
read/write pointer collisions. Read/write pointer collisions occur 
when old data is read out of the FIFO before new data has an 
opportunity to be written into the FIFO. Read/write pointer 
collisions also occur when new data overwrites the memory before 
the old data has an opportunity to be read out of the FIFO. The size 
of FIFO utilized herein, for example 2048 X 8, corresponds to 
approximately five lines. 

In accordance with an inventive arrangement, a field 
synchronization system for asynchronous video signals comprises a 
video display synchronized with a first video signal. The first video 
signal has a first line rate component and a first field rate 
component, corresponding to the horizontal and vertical 
synchronizing components of the first video signal. A field memory, 
having synchronous write and read ports, is provided for a second 
video signal. The second video signal has a second line rate 
component, corresponding to the horizontal synchronizing component 
of the second video signal. A multiple line memory (FIFO) for the 
second video signal has asynchronous write and read ports and 
independently resettable write and read pointers. The second video 
signal, subsampled if necessary, is stored in the field memory and 
written to the field memory synchronously with the second line rate 
component. The second video signal, subsampled if necessary, is 
written into the multiple line memory synchronously with the 
second line rate component. The data corresponding to the second 
video signal is therefor completely orthogonal, having been 
subsampled and stored synchronously with its own synchronizing 
components. The second video signal, subsampled if necessary, is 
read from the multiple line memory synchronously with the first 
line rate component. A sampling and delay circuit controls resetting 
the write and read pointers. A write pointer reset signal is 
generated by sampling the first field rate component with the 
second line rate component. The write pointer is reset up to one line 
period of the second video signal after every start of field of the 
first video signal. A read pointer reset signal is generated by 
sampling the first field rate component with the first line rate 
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component. The read pointer is reset at least two line periods of the 
first video s,gnal after every star, of field of the firs, video signal 
and more particularly, a, least two but not more than three line 
periods of the firs, video signal after every star, of fleW o, he 
first video signal. 

Date blocks from video RAM are written into 2048 x 8 FIFO 

r 6 40? in C '°H Ck h WaS , USSd t0 Samp ' e the video data ' ,or «*™P'e 
a 640f H clock which ,s locked to the auxiliary signal, rather than the 

main signaL The FIFO is read using the display dock frequency, 

example 1024f H , which is locked to horizontal synchronizing 

component of the main video channel. The use of a multiple line 

memory (FIFO, which has independent read and write pollocks 

enables data which was orthogonaUy sampled at a first rate to b e 

F^r the TT Y 1 3 SSCOnd rate ' ThS USe °< ,he synchronous 
FIFO for the auxiliary channel does not solve all of the problems 

associated with video synchronization. Since the reading and 

writing of data from the auxiliary channel FIFO is asynchronous 

there is the possibility of read/write pointer collision A 

read/write pointer collision occurs when a read enable signal is 

received before old data, that has already been read previously has 

be ee p n re r r:d ed * ^ ^ '"^ ^ "° 

A sufficiently large memory must be chosen in the first 
instance ,n order to avoid read/write pointer collision in the 
auxiliary channel FIFO. For displaying normal format display ratio 
video cropped by 33%, the auxiliary FIFO, which is 2048 X 8 in size 

°l St ° rin9 5 ' 9 " neS °' VidS0 d3ta ' for exam " le ' ° as ^ on' 
82/. active line period. An inventive arrangement recognizes that 

precession rates greater than 2 lines/field are not likely to be 
encountered. Therefore, a design criteria of a S line FIFO for the 
auxiliary channel can be sufficient to prevent read/write pointer 
collisions. 

< nm » Si " C K e m ! in aUXiliary Si9 " alS are synchronous, there is 
some ambiguity about exactly where the write pointer is when the 

read pointer is reset. It is known that the write pointer is leading 

the read pointer by at least two lines. However, if the frequency of 
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the auxiliary channel horizontal sync is higher than the frequency of 
the main channel horizontal sync, then the write pointer will have 
advanced past the second line. For different signals which have a 
precession rate less than 2 lines/field, the amount which the write 
pointer may have advanced may be, for example, 10 Bytes. 

It is in this way that a pointer collision is avoided for all 
signals with less than 2 lines/field precession rate. -The auxiliary 
channel FIFO can be partitioned into 5 line pieces through 
appropriately timed read and write reset signals. In this scheme, 
the read and write pointers are initialized at the beginning of each 
displayed field at least 2 lines apart from each other. 

If the FIFO were not a complete 5 lines long, the system would 
sacrifice the memory distance from the write pointer to the read 
pointer. This is the case for different squeeze modes. In the case of 
a 16% squeeze case, the actual FIFO length is 4.7 lines long. 
Therefore in the case of the write pointer catching up with the read 
pointer there is still at least 2.6 lines of memory in between the 
pointers at the start of the field. In the 33% squeeze case, the 
actual FIFO length is 4.0 lines long. This is not enough to insure 
pointer integrity for precession rates up to 2 lines/field. 

FIGURES 1(a)-1(i) are useful for explaining different display 
formats of a wide screen television. 

FIGURE 2 is a block diagram of a wide screen television in 
accordance with aspects of this invention and adapted for operation 
at 2fH horizontal scanning. 

FIGURE 3 is a block diagram of the wide screen processor 
shown in FIGURE 2. 

FIGURE 4 is a block diagram showing further details of the 
wide screen processor shown in FIGURE 3. 

FIGURE 5 is a block diagram of the picture-in-picture 
processor shown in FIGURE 4. 

FIGURE 6 is a block diagram of the gate array shown in 
FIGURE 4 and illustrating the main, auxiliary and output signal 
paths. 
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FIGURES 7 and 8 are timing diagrams useful for explaininq the 
generation of the display format shown in FIGURE 1(d), using fully 
cropped signals. y y 

FIGURE 9 is a block diagram of a circuit for generating the 
internal 2f H signal in the lf H to 2f H conversion 

Hflfl + RGURE 10 ,S 3 COmbination b,ock and circuit diagram for the 
deflection circuit shown in FIGURE 2. 

FIGURE^ 5 11 ^ 3 b, ° Ck dia9ram ° f RGB interf3Ce Sh0wn in 

FIGURE 12 is a block diagram of a portion of the auxiliary 
signal path shown in FIGURE 6. 

FIGURE 13 is a diagram of a five line FIFO line memory useful 
for explaining avoidance of read/write pointer collisions 

FIGURE 14 is a block diagram of a simplified circuit for 
.mplementmg an auxiliary path synchronizing circuit for the qate 
array. y 

n, ,/ IGUR ,f 15 ' S 3 timi " 9 diagram Mlus * ra t in 9 *e correspondence 
of an upper/lower held indicator to the horizontal lines of a video 

frame. 

FIGURES 16-18 are useful for explaining a method for 
maintaining interlace integrity for simultaneously displayed video 
signals exhibiting relative precession. 

The various parts of FIGURE 1 illustrate some, but not all of 
he various combinations of single and multiple picture display 
formats which can be implemented according to different inventive 
arrangements. Those selected for illustration are intended to 
facilitate the description of particular circuits comprising wide 
screen televisions according to the inventive arrangements For 
purposes of convenience in illustration and discussion herein a 
conventional display format ratio of width to height for a video 
source or signal is generally deemed to be 4 X 3, whereas a wide 
screen display format ratio of width to height for a video source or 
signal is generally deemed to be 16X9. The inventive 
arrangements are not limited by these definitions. 

FIGURE 1(a) illustrates a television, direct view or projection 
having a conventional format display ratio of 4 X 3. When a 16X9 
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format display ratio picture is transmitted, as a 4X3 format 
display ratio signal, black bars appear at the top and at the bottom. 
This is commonly referred to as letterbox format. In this instance, 
the viewed picture is rather small with respect to the entire 
available display area. Alternatively, the 16X9 format display 
ratio source is converted prior to transmission, so that it will fill 
the vertical extent of a viewing surface of 4 X 3 format display. 
However, much information will be cropped from the left and/or 
right sides. As a further alternative, the letterbox picture can be 
expanded vertically but not horizontally, whereby the resulting 
picture will evidence distortion by vertical elongation. None of the 
.three alternatives is particularly appealing. 

FIGURE 1(b) shows a 16X9 screen. A 16X9 format display 
ratio video source would be fully displayed, without cropping and 
without distortion. A 16X9 format display ratio letterbox 
picture, which is itself in a 4 X 3 format display ratio signal, can 
be progressively scanned by line doubling or line addition, so as to 
provide a larger display with sufficient vertical resolution. A wide 
screen television in accordance with this invention can display such 
a 16X9 format display ratio signal whether the main source, the 
auxiliary source or an external RGB source. 

FIGURE 1(c) illustrates a 16X9 format display ratio main 
signal in which a 4 X 3 format display ratio inset picture is 
displayed. If both the main and auxiliary video signals are 16X9 
format display ratio sources, the inset picture can also have a 
16X9 format display ratio. The inset picture can be displayed in 
many different positions. 

FIGURE 1(d) illustrates a display format, wherein the main and 
auxiliary video signals are displayed with the same size picture. 
Each display area has an format display ratio of 8X9, which is of 
course different from both 16X9 and 4X3. In order to show a 
4X3 format display ratio source in such a display area, without 
horizontal or. vertical distortion, the signal must be cropped on the 
left and/or right sides. More of the picture can be shown, with less 
cropping, if some aspect ratio distortion by horizontal squeezing of 
the picture is tolerated. Horizontal squeezing results in vertical 
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elongation of objects in the picture. The wide screen television 
according to th,s invention can provide any mix of cropping and 
aspect ratio distortion from maximum cropping with no aspe« ratio 
distortion to no cropping with maximum aspect ratio distortion 

Data sampling limitations in the auxiliary video signal 
processing path complicate the generation of a high resolution 
Picture which is as large in size as the display from the main video 
Signal Various methods can be developed for overcoming these 
complications. 

FIGURE 1(e) is a display format wherein a 4X3 format 
display ratio picture is displayed in the center of a 16 X 9 format 
display ratio screen. OarK bars are evident on the right and left 

T^V^ illUStrate$ a dis P |a y *>™« wherein one large 
4 X 3 format display ratio picture and three smaller 4 X 3 format 
d splay ratio pictures are displayed simuttaneously. A smaller 
PicUire outside the perimeter of the ,a,ge picture is sometimes 

PIP Aw 3 * ' ' *" 15 3 P ic,ure -°^e-picture, rather than a 
PIP, a p,cture-,n-p,cture. The terms PIP or picture-in-picture are 
used h er e ,n for both display formats. In those circumstances where 

IZT S ° reen te ' 9ViSi0n iS Pr ° Vided with ^ either bo" 

interna, or one internal and one external, for example in a video 

cassette recorder, two of the displayed pictures can display 

pictures can be displayed in freeze frame format. It will be 
appreciated that the addition of further tuners and additional 
auxiliary signal processing paths can provide for more than two 
moving pictures. It will also be appreciated that the large picture 
on the one hand, and the three small pictures on the other hand can 
be switched in position, as shown in FIGURE 1(g). 

FIGURE 1(h) illustrates an alternative wherein the 4 X 3 
format display ratio picture is centered, and six smaller 4 X 3 
format display ratio pictures are displayed in vertical columns on 
either side. As in the previously described format, a wide screen 
television provided with two tuners can provide two moving 
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pictures. The remaining eleven pictures will be in freeze frame 
format. 

FIGURE 1(i) shows a display format having a grid of twelve 
4X3 format display ratio pictures. Such a display format is 
particularly appropriate for a channel selection guide, wherein each 
picture is at least a freeze frame from a different channel. As 
before, the number of moving pictures will depend upon the number 
of available tuners and signal processing paths. 

The various formats shown in FIGURE 1 are illustrative, and 
not limiting, and can be implemented by wide screen televisions 
shown in the remaining drawings and described in detail below. 

An overall block diagram for a wide screen television in 
accordance with inventive arrangements, and adapted to operate 
with 2fH horizontal scanning, is shown in FIGURE 2 and generally 
designated 10. The television 10 generally comprises a video 
signals input section 20, a chassis or TV microprocessor 216, a 
wide screen processor 30, a 1fH to 2fH converter 40, a deflection 
circuit 50, an RGB interface 60, a YUV to RGB converter 240, kine 
drivers 242, direct view or projection tubes 244 and a power supply 
70. The grouping of various circuits into different functional blocks 
is made for purposes of convenience in description, and is not 
intended as limiting the physical position of such circuits relative 
to one another. 

The video signals input section 20 is adapted for receiving a 
plurality of composite video signals from different video sources. 
The video signals may be selectively switched for display as main 
and auxiliary video signals. An RF switch 204 has two antenna 
inputs ANT1 and ANT 2. These represent inputs for both off-air 
antenna reception and cable reception. The RF switch 204 controls 
which antenna input is supplied to a first tuner 206 and to a second 
tuner 208. The output of first tuner 206 is an input- to a one-chip 
202, which performs a number of functions related to tuning, 
horizontal and vertical deflection and video controls. The particular 
one-chip shown is industry designated type TA7730. The baseband 
video signal VIDEO OUT developed in the one-chip and resulting from 
the signal from first tuner 206 is an input to both video switch 200 
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and the TV1 inp ut of wide screen processor 30. Other baseband 
video mputs to video switch 200 are designated AUX1 and Tux 2 
These m,ght be used for video cameras, laser disc players video 
tape players, video games and the like. The output of Z vi l a 
switch 200. which is controlled by the chassis or ™ 1 
21 6 is designated SWITCHED VIDEO. ^.TCH o^T^ ' 
input to wide screen processor 30. 

With further reference to FIGURE 3, a switch SW1 wide screen 

SElToMP OUT 5 I 6 *" 6 " *• SW ' TCHED V,DEO 

The Y/? de^ S ' 9na ' "** iS a " input t0 a Y/C d *=°<^ »0 

I er ?woT h w maV 69 imp,emented « - adaptive line comb 

V/C h ,? n Sr r de ° S ° UrCeS 31 and 32 are ^ i"P"ts to the 

Y/C decoder 21 o. Each of S1 and S2 represent different S-VHS 

XT Tswltcf co h n r ot separa,e luminance and ch ~- 

signals. A switch, wh,ch may be incorporated as par, 0 f the Y/C 
decoder, as ,n some adaptive line comb filters, or which mayle 
impiemented as a separate switch, is responsive to the t7 
microprocessor 216 for selecting one pair of luminance and 
chrominance S1 gnals as outputs designated Y M and C IN 
respectively^ The selected pair of luminance" and chrominance 
signals ,s thereafter considered the main signal and is processed 
along a mam signal path. Signal designations including M or MN 
refer to the mam signal path. The chrominance signal C IN is 
redacted by the wide screen processor back to the oneVhip for 
developing color difference signals U_M and V M. ,„ Z regard u is 
an equivalent designation for ( R-Y, and V is a"n equivalent 

TET, (B " Y) - Y " M ' U - M ' a " d V " M ™ inverted 

The second tuner 208, functionally defined as part of the wide 
screen processor 30, develops a baseband video signal TV2 A 
switch SW2 selects between the TV2 and SWITCHED VIDEO signal* 
as an input to a Y/C decoder 220. The Y/C decoder 220 may bT 
implemented as an adaptive line comb filter. Switches SW3 and SW4 
select between the luminance and chrominance outputs of Y/C 
decoder 220 and the luminance and chrominance signals of an 
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external video source, designated Y_EXT and C_EXT respectively. The 
Y_EXT and C_EXT signals correspond to the S-VHS input S1 . The Y/C 
decoder 220 and switches SW3 and SW4 may be combined, as in some 
adaptive line comb filters. The output of switches SW3 and SW4 is 
thereafter considered the auxiliary signal and is processed along an 
auxiliary signal path. The selected luminance output is designated 
Y_A. Signal designations including _A, _AX and _AUX refer to the 
auxiliary signal path. The selected chrominance is converted to 
color difference signals U_A and V_A. The Y_A, U_A and V_A signals 
are converted to digital form for further signal processing. The 
arrangement of video signal source switching in the main and 
auxiliary signal paths maximizes flexibility in managing the source 
selection for the different parts of the different picture display 
formats. 

A composite synchronizing signal COMP SYNC, corresponding to 
Y_M is provided by the wide screen processor to a sync separator 
212. The horizontal and vertical synchronizing components H and V 
respectively are inputs to a vertical countdown circuit 214. The 
vertical countdown circuit develops a VERTICAL RESET signal which 
is directed into the wide screen processor 30. The wide screen 
processor generates an internal vertical reset output signal INT 
VERT RST OUT directed to the RGB interface 60. A switch in the RGB 
interface 60 selects between the internal vertical reset output 
signal and the vertical synchronizing component of the external RGB 
source. The output of this switch is a selected vertical 
synchronizing component SEL_VERT_SYNC directed to the deflection 
circuit 50. Horizontal and vertical synchronizing signals of the 
auxiliary video signal are developed by sync separator 250 in the 
wide screen processor. 

The 1fH to 2fH converter 40 is responsible for converting 
interlaced video signals to progressively scanned noninterlaced 
signals, for example one wherein each horizontal line is displayed 
twice, or an additional set of horizontal lines is generated by 
interpolating adjacent horizontal lines of the same field. In some 
instances, the use of a previous line or the use of an interpolated 
line will depend upon the level of movement which is detected 
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between adjacent fields or frames. The converter circuit 40 
operates ,n conjunction with a video RAM 420. The video RAM may 
be used to store one or more fields of a frame, to enable the 
progressive display. The converted video data as Y 2f H , U 2f H and 
V_2f H signals is supplied to the RGB interface 60. ~ 

The RGB interface 60. shown in more detail in FIGURE 1 1 
enables selection of the converted video data or external RGB video 
data or display by the video signals input section. The external RGB 
signal ,s deemed to be a wide format display ratio signa! ad ap ed 1 0r 
2f H scannmg. The vertical synchronizing component of the main 

■aHNT'tERTRSTOUT 9 RG *. in,9rtaC8 «* *• —en processor 
•as int VERT RST OUT, enabling a selected vertical sync (f Vm or f» ,i 

ci e n a rf ab,e to the de,iection eireuit 5 °- OP*"*" aZZZ? 

screen telev.s.on enab.es user selection of an externa, RGB signal 
by generatmg an internal/external control signal INT/EXT. However 
the selection of an external RGB signal input, in the absence of such 

the S c a lr n Tk i0 VertiCa ' C °" aPSe °' the raster ' a " d *"»«• to 
the cathode ray tube or projection tubes. Accordingly, the RGB 

interface arcuit detects an external synchronizing signal in order 
to override the selection o, a non-existent externa? RGB input. The 
WSP microprocessor 340 also supplies color and tin, controls for 
the external RGB signal. 

The wide screen processor 30 comprises a picture in picture 
processor 320 for special signal processing of the auxiliary video 
signal. The term picture-in-picture is sometimes abbreviated as 
PIP or p,x-m-pix. A gate array 300 combines the main and auxiliary 
video signal data in a wide variety of display formats, as shown by 
the examptes of FIGURES 1(b) through 1<i>. The . picture-in-picture 
processor 320 and gate array 300 are under the control of a wide 
screen microprocessor (WSP uP) 340. Microprocessor 340 is 
responsive to the TV microprocessor 216 over a serial bus The 
serial bus includes four signal lines, for data, clock signals, enable 
signals and reset signals. The wide screen processor 30 also 
generates a composite vertical blanking/reset signal, as a three 
level sandcastle signal. Alternatively, the vertical blanking and 
reset s.gnals can be generated as separate signals. A composite 
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blanking signal is supplied by the video signal input section to the 
RGB interface. 

The deflection circuit 50, shown in more detail in FIGURE 10, 
receives a vertical reset signal from the wide screen processor, a 
selected 2fn horizontal synchronizing signal from the RGB interface 
60 and additional control signals from the wide screen processor. 
These additional control signals relate to horizontal -phasing, 
vertical size adjustment and east-west pin adjustment. The 
deflection circuit 50 supplies 2fn flyback pulses to the wide screen 
processor 30, the 1fH to 2fn converter 40 and the YUV to RGB 
converter 240. 

Operating voltages for the entire wide screen television are 
generated by a power supply 70 which can be energized by an AC 
mains supply. 

The wide screen processor 30 is shown in more detail in 
FIGURE 3. The principal components of the wide screen processor 
are a gate array 300, a picture-in-picture circuit 301, analog to 
digital and digital to analog converters, the second tuner 208, a 
wide screen processor microprocessor 340 and a wide screen output 
encoder 227. Further details of the wide screen processor are 
shown in FIGURE 4. A picture-in-picture processor 320, which 
forms a significant part of the PIP circuit 301, is shown in more 
detail in FIGURE 5. The gate array 300 is shown in more detail in 
FIGURE 6. A number of the components shown in FIGURE 3 have 
already been described in detail. 

The second tuner 208 has associated therewith an IF stage 224 
and an audio stage 226. The second tuner 208 also operates in 
conjunction with the WSP u.P. 340. The WSP uP 340 comprises an 
input output I/O section 340A and an analog output section 340B. 
The I/O section 340A provides tint and color control signals, the 
INT/EXT signal for selecting the external RGB video source and 
control signals for the switches SW1 through SW6. The I/O section 
also monitors the EXT SYNC DET signal from the RGB interface to 
protect the deflection circuit and cathode ray tube(S). The analog 
output section 340B provides control signals for vertical size, east- 
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west adjust and horizontal phase, through respective interface 
circuits 254, 256 and 258. 'menace 

The gate array 300 is responsible for combining video 
information from the main and auxiliary signal paths to implement a 
composite w,de screen disp.av, for example one o, those shown in 
he different parts of FIGURE 1. Clock information for the gate array 

w,tn low pass filter 376. The main video signal is supplied to the 
wide screen processor in analog form, and Y U V format as Inl 
designated Y_M, U_M and V_M. These main signals TooleZ 
from analog to digital form by analog to digital converters 342 and 
346, shown in more detail in FIGURE 4. 

The color component signals are referred to by the generic 
designations U and V, which may be assigned to either R-Y or B Y 

m»ed 'tTa mm °k Si9 " alS - SamplSd ' UminanCe bandwidth 
l.m.ted to 8 MHz because the system clock rate is l024f H which is 

approximately 16 MHz. A single analog to digital converts and an 

analog switch can be used to sample the color component date 

w^Tl rT 7 ^ ^" alS ^ ' imited 10 500 Kte ' 0' I* "Hz for 
344, ,s an 8 MHz s,gnal dewed by dividing the system clock by 2 A 
one dock wide start of line SOL pulse synchronously resets this 

uTm. y b89innin9 MCh h0riz0n,a ' vide ° The 

UV.MUX line than toggles in state each clock cycle through the 

honzonta l.ne. Since the line length is an even number of clock 

S 0 1 9 oT °' ^ r- MUX ' ° nC8 initia,iZed ' 

toggle 0, 1 , 0, 1 without interruption. The Y and UV data 

streams out of the analog to digital converters 342 and 346 are 

cvl of T T° 9 * di9ital C ° nVerterS 83Ch have 1 *ck 

cycle of delay In order to accommodate for this data shift, the 

dock gating information from the main signal processing path 304 
must be similarly delayed Were the ehv* • < 

rf=i=„.j .u , .., ck Qatin 9 information not 

delayed, the UV data will not be correctly paired when deleted This 

m t> on x* because each UV pair represents one vector A U ' 
element from one vector cannot be paired with a V element from 
another vector without causing a color shift. Instead a V sample 



WO 91/19379 



-15- 



PCT/US9 1/03745 



from a previous pair will be deleted along with the current U sample. 
This method of UV multiplexing is referred to as 2:1:1. as there are 
two luminance samples for every pair of color component (U, V) 
samples. The Nyquist frequency for both U and V is effectively 
reduced to one half of the luminance Nyquist frequency. Accordingly, 
the Nyquist frequency of the output of the analog to digital 
converter for the luminance component is 8 MHz, whereas the 
Nyquist frequency of the output of the analog to digital converter for 
the color components is 4 MHz. 

The PIP circuit and/or the gate array may also include means 
for enhancing the resolution of the auxiliary data notwithstanding 
the data compression. A number of data reduction and data 
restoration schemes have been developed, including for example 
paired pixel compression and dithering and dedithering. Moreover, 
different dithering sequences involving different numbers of bits 
and different paired pixel compressions involving different numbers 
of bits are contemplated. One of a number of particular data 
reduction and restoration schemes can be selected by the WSP jiP 
340 in order to maximize resolution of the displayed video for each 
particular kind of picture display format. 

The gate array includes interpolators which operate in 
conjunction with line memories, which may be implemented as 
FIFO's 356 and 358. The interpolator and FIFO's are utilized to 
resample the main signal as desired. An additional interpolator can 
resampte the auxiliary signal. Clock and synchronizing circuits in 
the gate array control the data manipulation of both the main and 
auxiliary signals, including the combination thereof into a single 
output video signal having Y_MX, U_MX and V_MX components. These 
output components are converted to analog form by digital to analog 
converters 360, 362 and 364. The analog form signals, designated Y, 
U and V, are supplied to the 1fn to 2fH converter 40 for conversion 
to noninterlaced scanning. The Y, U and V signals are also encoded to 
Y/C format by encoder 227 to define a wide format ratio output 
signal Y_OUT_EXT/C_OUT_EXT available at panel jacks. Switch SW5 
selects a synchronizing signal for the encoder 227 from either the 
gate array, C_SYNC_MN, or from the PIP circuit, C_SYNC_AUX. 
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Switch SW6 selects between Y M and C <5vwr a., v 

signal tor ,he wide screen pan* out p U f " " m ™ in * 

m oredlT:n S ^URV 9 °% 0 lVr hrOni2in9 ^ " ^ '« 
rilJUM fe rnase comparator 29ft ie . 

resonator or the like 238 Th» . response to a ceramic 

■are supplied to a divide by 16 counter 400 A 2? T* ^ 
.= a pulse width circuit 40^. Prese^ldtr^ L'lKS 
s.gnal assures that the divider operates synchronousfy w'h the 
Phase ocked loop of the video signais input seoSon P u T e w w,h 

locked loop mcluding tow pass filter 406 and 2f H voSge control 
oscllator 408. Voltage controlled oscillator 408 generates a 
'n«erna, 2 f H timing signa| , whjch js used ^ ™°*™*° s 

progressively scanned display. The other input signal to phase 

comn , ! n USS ° f S6COnd Ph3Se locked '°°P including phLse 
s ~ ic 4 ° 4 , S US8fUl aSSUri " 9 that ^ 2f H scan ing period 
L TJT " MCh 1,H PSri0d 0f the in ° u < Signal. Otherwise 

he display may exhibit a raster split, for example wherein ha7 of ' 

Ih^dto ThV len. Shift6d t0 ^ - - - - ^ S are 

A C ir7 h ( %nf e ° ti0n CifCUit 50 iS Sh0W " more deta " i" FIGURE 10 
A c.rcu.t 500 ,s provided for adjusting the vertical size of the 

raster. ,n accordance with a desired amount of vertical overscan 

necessary for implementing different display formats As 

illustrated diagrammatically, a constant current source 502 

prov,des a constant quantity of current l RAMP which charges a 

vertical ramp capacitor 504. A transistor 506 is coupled in parallel 
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with the vertical ramp capacitor, and periodically discharges the 
capacitor responsive to the vertical reset signal. In the absence of 
any adjustment, current Iramp provides the maximum available 
vertical size for the raster. This might correspond to the extent of 
vertical overscan needed to fill the wide screen display by an 
expanded 4X3 format display ratio signal source, as shown in 
FIGURE 1(a). To the extent that less vertical raster .size is required, 
an adjustable current source 508 diverts a variable amount of 
current I ad J from Iramp. so that vertical ramp capacitor 504 charges 
more slowly and to a smaller peak value. Variable current source 
508 is responsive to a vertical size adjust signal, for example in 
analog form, generated by a vertical size control circuit. Vertical 
size adjustment 500 is independent of a manual vertical size 
adjustment 510, which may be implemented by a potentiometer or 
back panel adjustment knob. In either event, the vertical deflection 
coil(s) 512 receive(s) driving current of the proper magnitude. 
Horizontal deflection is provided by phase adjusting circuit 518, 
East-West pin correction circuit 514, a 2fn phase locked loop 520 
and horizontal output circuit 516. 

The RGB interface circuit 60 is shown in more detailed in 
FIGURE 11. The signal which is to be ultimately displayed will be* 
selected between the output of the 1fH to 2fn converter 40 and an 
external RGB input. For purposes of the wide screen television 
described herein, the external RGB input is presumed to be a wide 
format display ratio, progressively scanned source. The external 
RGB signals and a composite blanking signal from the video signals 
input section 20 are inputs to an RGB to Y U V converter 610. The 
external 2fH composite synchronizing signal for the external RGB 
signal is an input to external synchronizing signal separator 600. 
Selection of the vertical synchronizing signal is implemented by 
switch 608. Selection of the horizontal synchronizing signal is 
implemented by switch 604. Selection of the video signal is 
implemented by switch 606. Each of the switches 604, 606 and 608 
is responsive to an internal/external control signal generated by the 
WSP nP 340. Selection of internal or external video sources is a 
user selection. However, if a user inadvertently selects an external 
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RGB source, when no such source is connected or turned on or if *. 
externa, source drops out. the vertical raster will collapse and 
serious damage to the cathode ray tubers) can result a~„ „ , 
an external synchronizing detector 602 checte foT thl' n ACCOrd,n9l >'' 
external synchronizing signal. In the S£S ° " 

6^60^ Si9na ' iS tranSmitted t0 

th e *'. , T ' PreV8nt Se ' eCti0n 0f the RGB source if 

the signal therefrom is not present. The RGB to YUV converter 610 

3nd C0 ' 0r contral si3nals fr <"" *• wspT 40° 

win. . ' S 3 0CK dia9ram showin 9 ,urth9r flails of the ' 

wide screen processor 30 shown in FIGURE 3. The Y A, U A and V A 
.signals are an input ,o the picture in picture processo 320 which" 
can include a resolution processing circuit 370 The wide scr-n 
television according to aspects of this invention can expand and 
compress videc. The special effects embodied by the value 
composite display formats illustrated in par, in RGURE 1 are 
generated by the picture-in-picture processor 320. which can 
receive resolution processed data signals Y RP U RpTnd Tno , 
resoiution processing circuit 370. ^T^^n^* * 
u Hized at al, times, but during selected display formats. The 
p,c(ure.,n-p,cture processor 320 is shown in more detail in FIGURE 
5. The principal components of the picture-in-picture processor are 

"stltr<FswT' TT" sec * on 322 ' *»* se « ion 324 * 

Tast switch (FSW) and bus section ^ 

35B »„h „ m \ T section 326, a timing and control section 

328 and a digital-to-analog converter section 330 

The picture-in-picture processor 320 may be embodied as an 

'ooZlrTT 0 ' 3 baSiC CPIP CWP deVe ' 0 ^ * Thor^n 
funv i 77 1 7v T % ' lnC ' Th " b3SiC CPIP chip * more 
Techn , P r Ub " Cat ' 0n en,itled The CTC 140 Picture in Picture (CPIP, 
Technical Training Manual, available from Thomson Consumer 
Electronics, Inc., Indianapolis, Indiana. A number of special features 
or special effects are possible, the following being illustrative The 
basic special effect is a large picture having a small picture 

IZZ"^ 3 P0,ti0n th6re0f 35 Sh ° Wn in RGURE 1 <«' ^e large and 
small pictures can result from the same video signal, from different 
video signals and can be interchanged or swapped GeneraNy 
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speaking, the audio signal is switched to always correspond to the 
big picture. The small picture can be moved to any position on the 
screen or can step through a number of predetermined positions. A 
zoom feature increases and decreases the size of the small picture, 
for example to any one of a number of preset sizes. At some point, 
for example the display format shown in FIGURE 1(d), the large and 
small pictures are in fact the same size. 

In a single picture mode, for example that shown in FIGURES 
1(b), 1(e) or 1(f) a user can zoom in on the content of the single 
picture, for example, in steps from a ratio of 1.0:1 to 5.0:1. While in 
the zoom mode a user may search or pan through the picture content 
.enabling the screen image to move across different areas of the 
picture. In either event, either the small picture or the large picture 
or the zoomed picture can be displayed in freeze frame (still picture 
format). This function enables a strobe format, wherein the last 
nine frames of video can be repeated on the screen. The frame 
repetition rate can be changed from thirty frames per second to zero 
frames per second. 

The picture-in-picture processor used in the wide screen 
television according to another inventive arrangement differs from 
the present configuration of the basic CPIP chip described above. If 
the basic CPIP chip were used with a television having a 16X9 
screen, and without a video speed up circuit, the inset pictures 
would exhibit aspect ratio distortion, due to the effective */ 3 times 
horizontal expansion resulting from scanning across the wider 
16X9 screen. Objects in the picture would be horizontally 
elongated. If an external speed up circuit were utilized, there would 
be no aspect ratio distortion, but the . picture would not fill the 
entire screen. 

Existing picture-in-picture processors based on the basic 
CPIP chip as used in conventional televisions are operated in a 
particular fashion having certain undesirable consequences. The 
incoming video is sampled with a 640fH clock which is locked to the 
horizontal synchronizing signal of the main video source. In other 
words, data stored in the video RAM associated with the CPIP chip is 
not orthogonally sampled with respect to the incoming auxiliary 
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H S T, e m iS 3 ,undamental Citation on the basic CP.P 
method of f,eld synchronization. The nonorthogonai nature of the 
input sampling rate resu.ts in skew errors of th'e samp?* data The 
limitation ,s a result of the video RAM used with the CPIP cL 
which must use the same clock for writing and reading data When 
data from the video RAM. such as video RAM 350. is displayed Z 
skew errors are seen as random jitter along vertical -edges of' the 
picture and are generally considered quite objectionable 

The p,cture-in-picture processor 320, according to an 
mvenfve arrangement and unlike the basic CPIP chip, is adapted for 
asymmetnca.lv compressing the video data in one of a 5 
selectable display modes. In this mode of operation, the pieces 
are compressed 4:1 in the horizontal direction and 3:1 in the vertical 

^"o distortld m ° d9 °' C0mpr9SSi0 " P~du=es aspec 

ratio d,storted p,ctures for storage in the video RAM. Objects in the 

pictures are squeezed horizontally. However, if these picturesare 

mad out normally, as for example in the channel scan mode for 

d.splay of a 16X9 format display ratio screen, the pictures appear 

? h Pi0,Ure fi " S the SCree " and *™ " *» ^ « Jo 
ZZT; J aSymmetriC comDressio " according to ,h 

aspect of the invention makes it possible to generate the special 
d-spla^ormats on a 16X9 screen without externa, speed T 

,„„• "V" SC ^ en P ' P m0dSS ' the P^^-in-Picture processor in 
conjunction w,th a free running oscillator 348 will take Y/C inpu 

SnanntrT? U v' *" " n6 COmb ,ilter ' de *° d * *• 

signal n to Y, U, V color components and generate horizontal and 

verbal sync pulses. These signals are processed in the picture-in- 

picture processor for the various full screen modes such as zoom 

freeze and channel scan. During the channel scan mode, for example 

and vertical sync presem ,rom * s ^ C 

section w,ll have many discontinuities because the signals sampled 
d, erent channels, will have non-related sync pulses and wil, be 
switched at seemingly random moments in time. Therefore the 
sample clock (and read/write video RAM clock) is determined by the 
free running oscillator. For freeze and zoom modes, the sample 
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clock will be locked to incoming video horizontal sync, which in 
these special cases is the same as the display clock frequency. 

Referring again to FIGURE 4, Y, U, V and C_SYNC (composite 
sync) outputs from the picture-in-picture processor in analog form 
can be re-encoded into Y/C components by encode circuit 366, which 
operates in conjunction with a 3.58 MHz oscillator 380. This 
Y/C_PIP_ENC signal may be connected to a Y/C switch, not shown, 
which enables the re-encoded Y/C components to be substituted for 
the Y/C components of the main signal. From this point on, the PIP 
encoded Y, U. V and sync signals would be the basis for horizontal 
and vertical timing in the rest of the chassis. This mode of 
operation is appropriate for implementing a zoom mode for the PIP, 
based upon operation of the interpolator and FIFO's in the main 
signal path. 

With further reference to FIGURE 5, the picture-in-picture 
processor 320 comprises analog to digital converting section 322, 
input section 324, fast switch FSW and bus control section 326, 
timing and control section 328 and digital to analog converting 
section 330. In general, the picture-in-picture processor 320 
digitizes the video signal into luminance (Y) and color difference 
signals (U, V), subsampling and storing the results in a 1 megabit 
video RAM 350 as explained above. The video RAM 350 associated 
with the picture-in-picture processor 320 has a memory capacity of 
1 megabit, which is not large enough to store a full field of video 
data with 8-bit samples. Increased memory capacity tends to be 
expensive and can require more complex management circuitry. The 
smaller number of bits per sample in the auxiliary channel 
represents a reduction in quantization resolution, or bandwidth, 
relative to the main signal, which is processed with 8-bit samples 
throughout. This effective reduction of bandwidth is not usually a 
problem when the auxiliary displayed picture is relatively small, but 
can be troublesome if the auxiliary displayed picture is larger, for 
example the same size as the main displayed picture. Resolution 
processing circuit 370 can. selectively implement one or more 
schemes for enhancing the quantization resolution or effective 
bandwidth of the auxiliary video data. A number of data reduction 
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and data restoration schemes have been developed, including for 
example, paired pixel compression and dithering and dedithering A 
ded-thering circuit would be operatively disposed downstream of the 
v,deo RAM 350, for example in the auxiliary signal path of the gate 
array, as explained in more detail below. Moreover, different 
dithering and dedithering sequences involving different numbers of 
bits and different paired pixel compressions involving different 
number of bits are contemplated. One of a number of particular data 
reduct.on and restoration schemes can be selected by the WSP U P in 
order to maximize resolution of the displayed video for each 
particular kind of picture display format. 

The luminance and color difference signals of the auxiliary 
signa are stored in an 8:1:1 six-bit Y, U ,V fashion in a video RAM 
350 forming part of the picture- in -picture processor. In other 
words, each component is quantized into six-bit samples. There are 
eight luminance samples for every pair of color difference samples 
Briefly the picture-in-picture processor 320 is operated in a mode 
whereby .ncoming video data is sampled with a 640f H clock rate 
ocked to the incoming auxiliary video synchronizing signal instead. 
In this mode, data stored in the video RAM 350 is orthogonally 
sampled. When the data is read out of the picture-in-picture 
processor video RAM 350, it is read using the same 640f H clock 
ocked to the incoming auxiliary video signal. However, even though 
this data was orthogonally sampled and stored, and can be read out 
orthogonally, it cannot be displayed orthogonally directly from the 
video RAM 350, due to the asynchronous nature of the main and 
auxiliary video sources. The main and auxiliary video sources might 
be expected to be synchronous only in that instance where they are 
displaying signals from the same video source. 

The main signal path 304, auxiliary signal path 306 and output 
signal path 312 of the gate array 300 are shown in block diagram 
form in FIGURE 6. The gate array also comprises a clocks/sync 
circuit 320 and a WSP uP decoder 310. Data and address output 
lines of the WSP uP decoder 310, identified as WSP DATA are 
supplied to each of the main circuits and paths identified above as 
well as to the picture-in-picture processor 320 and resolution ' 
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processing circuit 370. It will be appreciated that whether or not 
certain circuits are, or are not, defined as being part of the gate 
array is largely a matter of convenience for facilitating explanation 
of the inventive arrangements. 

The gate array is responsible for expanding, compressing and 
cropping video data of the main video channel, as and if necessary, 
to implement different picture display formats. The luminance 
component Y_MN is stored in a first in first out (FIFO) line memory 
356 for a length of time depending on the nature of the interpolation 
of the luminance component. The combined chrominance components 
U/V_MN are stored in FIFO 358. Auxiliary signal luminance and 
chrominance components Y_P!P, U_PIP and V_PIP are developed by 
demultiplexer 355. The luminance component undergoes resolution 
processing, as desired, in circuit 357, and is expanded as necessary 
by interpolator 359, generating signal Y_AUX as an output. 

In some instances, the auxiliary display will be as large as the 
main signal display, as shown for example in FIGURE 1(d). The 
memory limitations associated with the picture-in-picture 
processor and video RAM 350 can provide an insufficient number of 
data points, or pixels for filling such a large display area. In those 
circumstances, resolution processing circuit 357 can be used to 
restore pixels to the auxiliary video signal to replace those lost 
during data compression, or reduction. The resolution processing 
may correspond to the resolution processing undertaken by circuit 
370 shown in FIGURE 4. As an example, circuit 370 may be a 
dithering circuit and circuit 357 may be a dedithering circuit. 

With further reference to FIGURE 12, the auxiliary video input 
data is sampled at a 640f H rate and stored in video RAM 350. The 
auxiliary data is read out of video RAM 350 is designated VRAM.OUT. 
The PIP circuit 301 also has the capability of reducing the auxiliary 
picture by equal integer factors horizontally and vertically, as well 
as asymmetrically. The auxiliary channel data is buffered and 
synchronized to the main channel digital video by the 4 bit latches 
352A and 352B, the auxiliary FIFO 354, timing circuit 369 and 
synchronization circuit 368. The VRAM.OUT data is sorted into Y 
(luminance), U, V (color components), and FSW_DAT (fast switch 
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data) by demultiplexer 355. The FSW.DAT indicates which field 
type was written into the video RAM. The PIP FSW signal is 
received directly from the PIP circuit and applied to the output 
control court 321 to determine which field read out of video RAM 
is to be displayed during the small picture modes 

The auxiliary channel is sampled at 640f H rate while the main 
channel is sampled at a 1024fu rata th« „..„■. ,_ 
„„„„ „,„ * , U,W ' H rate - i" 6 auxiliary channel FIFO 354 
converts he data from the auxiliary channel sample rate to the main 

, ra,e ' ** Pr0CeSS ' ,h6 Vide ° Si ' nal -dergoi an 
•/6 (1024/mo, compression. This is more than the 4, 3 compression 
necessary to correctly display the auxiiiary channel signal 
.Therefore, the auxiliary channel must be expanded by the 
m erpo later 359 to correctly display a 4 X 3 small picture The 

S f 9 iS COn,r °" ed * ^"olator control circuit 371 
which is itself responsive to WSP u.P 340. The amount of 
mterpolator expansion required is 5/ s . The expansion factor X is 
determined as follows: 

X - (640/, 024) . ( 4/ 3) . 5/s 

The chrominance components U_P!P and V PIP are delaved hv 

inT , f *V le " 9th °' depSndi "S °" ^ ™£ of T Y 

Lnd V aC ' UminanCe 0OmpOnen, • -Snals U AUX 

and V.AUX as outputs. The respective Y, U and V components oTthe 

riS^TT a^ IT ^ C ° mbined ^ r - p -«ve P mu^ p , s 
read I Jj. ■ , ?° ^ Path 312 ' * controlling the 

31* 3 7 and 9 ^ 3 *" ^ 356 ^ The <«^™ 

circuit 321 o t V ? SP ° nSiVe '° m rnu,,iplexer 

circurt 321. Output mulhplexer control circuit 321 is responsive to 

L , S T!!' 3 St3rt °' Si9nal ' 3 hori20nta ' eoumer sla 

IT 3 f rSSet Si9na ' and ° utput °< *. fast swTh 

from the p.cture-in-picture processor and WSP R P 340 The 

multiplexed luminance and chrominance components Y_MX, U MX and 
a - M ^ re SUpP " ed , t0 res P ec,ive digital/analog converters 3~60, 362 
and 364 respecfvely. The digital to analog converters are Wowed 
by low pass filters 361. 363 and 365 respectively, shown in FIGURE 
4^ The vanous functions of the picture-in-picture processor the 
gate array and the data reduction circuit are controlled by WSP uP 
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340. The WSP uP 340 is responsive to the TV uP 216, being 
connected thereto by a serial bus. The serial bus may be a four wire 
bus as shown, having lines for data, clock signals, enable signals and 
reset signals. The WSP uP 340 communicates with the different 
circuits of the gate array through a WSP uP decoder 310. 

In one case, it is necessary to compress the 4 X 3 NTSC video 
by a factor of 4/3 to avoid aspect ratio distortion of -the displayed 
picture. In the other case, the video can be expanded to perform 
horizontal zooming operations usually accompanied by vertical 
zooming. Horizontal zoom operations up to 33% can be accomplished 
by reducing compressions to less than 4/3. A sample interpolator is 
used to recalculate the incoming video to a new pixel positions 
because the luminance video bandwidth, up to 5.5 MHz for S-VHS 
format, occupies a large percentage of the Nyquist fold over 
frequency, which is 8 MHz for a 1024fH clock. 

As shown in FIGURE 6, the luminance data Y_MN is routed 
through an interpolator 337 in the main signal path 304 which 
recalculates sample values based on the compression or the 
expansion of the video. The function of the switches or route 
selectors 323 and 331 is to reverse the topology of the main signal 
path 304 with respect to the relative positions of the FIFO 356 and 
the interpolator 337. In particular, these switches select whether 
the interpolator 337 precedes the FIFO 356, as required for picture 
compression, or whether the FIFO 356 precedes the interpolator 337, 
as required for picture expansion. The switches 323 and 331 are 
responsive to a route control circuit 335, which is itself responsive 
to the WSP uP 340. It will be remembered that the auxiliary video 
signal is compressed for storage in the video RAM 350, and only 
expansion is necessary for practical purposes. Accordingly, no 
comparable switching is required in the auxiliary signal path. 

In order to implement video compressions through the use of a 
FIFO, for example, every fourth sample can be inhibited from being 
written into the FIFO 356. This constitutes a 4/3 compression. It is 
the function of the interpolator 337 to recalculate the luminance 
samples being written into the FIFO so that the data read out of the 
FIFO is smooth, rather than jagged. Expansions may be performed in 
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exactly the opposite manner as compressions. In the case of 

anZ!f th9 jT enab ' e Si9 " al h3S C ' 0Ck 9 ati "9 inf °«"a«°" 
attached to ,t .n the form of inhibit pulses. For expanding data, the 

clock ga „ng ^formation is applied to the read enable signal This 

«n pause the data as it is being read from the FIFO 356 In this 

ncA ,lJn ° ti0n ° f thS inter P° lat °' 337, which follows the 

FIFO 356 durmg this process, to recalculate the sampled data from 
jagged to smooth. In the expansion case the data must pause while 
be,ng read from the FIFO 356 and while being clocked into the 
interpolator 337. This is different from the compression case 
where the data is continuously clocked through the interpolator 337 
•For both cases, compression and expansion, the clock gating 
operations can easily be performed in a synchronous manner, that is 
events can occur based on the rising edges of the system clock ' 

Interpolation of the auxiliary signal takes place in the 

M UX v a ^ S ' 9 "l Path 306 ' The PIP circuit 301 manipulates a 6 bi, Y. 
U, V, 8/L1 field memory, video RAM 350, to store incoming video 
data. The y,deo RAM 350 holds two fields of video data in a plurality 

in T a T7H?? ti0nS - EaCh mem0ry l0Cati0n holds ei 9"< »• of data 
n each 8-b.t locabon there is one 6-bit Y (luminance) sample 

(sampled at 640f H ) and 2 other bits. These two other bits hold 

erther fast switch data (FSW.DAT) or part of a U or V sample 

(sampled at 80f H ). The FSW.DAT values indicate which type of field 

was wntten into video RAM. Since there are two fields of data 

stored in the video RAM 350. and the entire video RAM 350 is read 

dunng the display period, both fields are read during the display 

scan. The PIP circuit 301 will determine which field will be read 

ou of the memory to be displayed through the use of the fast switch 

data. The PIP circuit always reads the opposite field type that is 

betng wntten to overcome a motion tear problem. If the field type 

being read is the opposite type than that being displayed, then the 

even field stored in the video RAM is inverted by deleting the top 

ine of the field when the field is read out of memory. The result ,s 

hat the small picture maintains correct interlace without a motion 
tear. 
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The clocks/sync circuit 320 generates read, write and enable 
signals needed for operating FIFOs 354, 356 and 358. The FIFOs for 
the main and auxiliary channels are enabled for writing data into 
storage for those portions of each video line which is required for 
subsequent display. Data is written from one of the main or 
auxiliary channels, but not both, as necessary to combine data from 
each source on the same video line or lines of the display. The FIFO 
354 of the auxiliary channel is written synchronously with the 
auxiliary video signal, but is read out of memory synchronously with 
the main video signal. The main video signal components are read 
into the FIFOs 356 and 358 synchronously with the main video 
signal, and are read out of memory synchronously with the main 
video. How often the read function is switched back and forth 
between the main and auxiliary channels is a function of the 
particular special effect chosen. 

Generation of different special effects such as cropped side- 
by-side pictures are accomplished through manipulating the read and 
write enable control signals for the line memory FIFOs. The process 
for this display format is illustrated in FIGURES 7 and 8. In the case 
of cropped side-by-side displayed pictures, the write enable control 
signal (WR_EN_AX) for 2048 X 8 FIFO 354 of the auxiliary channel is 
active for 0/2)*( s h2) - s h2 or approximately 41% of the display 
active line period (post speed up), or 67% of the auxiliary channel 
active line Reriod (pre speed up), as shown in FIGURE 7. This 
corresponds to approximately 33% cropping (approximately 67% 
active picture) and the interpolator expansion of the signal by 5/ 6 . 
In the main video channel, shown in the upper part of FIGURE 8, the 
write enable control signal (WR_EN_MN_Y) for the 910 X 8 FIFOs 356 
and 358 is active for (V 2 )*( 4 /3) « 0.67 or 67% of the display active 
line period. This corresponds to approximately 33% cropping and a 
compression ratio of */ 3 being performed on the main channel video 
by the 910 x 8 FIFOs. 

In each of the FIFOs, the video data is buffered to be read out 
at a particular point in time. The active region of time where the 
data may be read out from each FIFO is determined by the display 
format chosen. In the example of the side-by-side cropped mode 
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ha°f of' ,h! h ? T ^ iS b8in9 displa * ed °" *e left hand 
half of the display and the auxiliary channel video is displayed on 
the nght hand half of the display. The arbitrary video pol ns of 

la^O x 8 P^ 0 r TT Si9na ' (RD - EN -MN, of the main 
channel 910 x 8 FIFOs is active for 50% of the display active line 
penod of the display beginning wrth the start of active vTdeo 

Z ' at H, y ,0 "° Win9 Vid8 ° b3Ck POfCh - The *"*«ary channel 
read enable control signal (RD_EN_AX, is active for the other 50% of 

RD cu wl aCt ' Ve " ne Peri0d be 9 inni "9 *e falling edge of L 

video from porch. It may be noted that write enable control sionals 
are synchronous with their respective FIFO input data (ma n o 

% T enab,e ™ ^ 

witn the main channel video. 

The display format shown in FIGURE 1(d) is particular^ 
desirable as it enables two near,y ful, field pictures tHis"' in 
a side by side format. The display „ particu , arlv effected 

x°9 pr,a Mo ,ormat disp,ay ra,io dispia ^ *" «S 

16 X 9. Most NTSC s.gnals are represented in a 4 X 3 format 

Ta o NTSC r COrreSP °; dS '° 12 X 9 - TW ° 4X3 « Xplay 
ratio NTSC pictures may be presented on the same 16X9 format 

dKplay ratio display, either by cropping the pictures by 33% o7 

istoTn 9 D Pi T S ^ 33% ' ^ introdUCin9 
distortion. Dependmg on user preference, the ratio of picture 

cropping to aspect ratio distortion may be set any where in between 

ml f * 0O tf nd 33% - * a " SXample ' »» ^ "y side pictres 
may be presented as 1 6.7 % squeezed and 1 6.7% cropped 

The horizontal display time for a 16X9 format display ratio 

both h ' S , R ,% Same " 3 4X3 ' 0rma, diSpla ' ra «° display bed se 
both have 62 5 microsecond nominal line length. Accordingly, an 

NTSC video signal must be sped up by a factor of 4/ 3 , 0 p , eserve a 
correct aspect ratio, without distortion. The </ 3 factor is 
calculated as ratio of the two display formats: 

4 '3 - ('6/9) / (4/ 3) 
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Variable interpolators are utilized in accordance with aspects of 
this invention to speed up the video signals. In the past, FIFOs 
having different clock rates at the inputs and outputs have been used 
to perform a similar function. By way of comparison, if two NTSC 
4X3 format display ratio signals are displayed on a single 4X3 
format display ratio display, each picture must be distorted or 
cropped, or some combination thereof, by 50%. A speed up 
comparable to that needed for a wide screen application is 
unnecessary. 

Generally, the video display and deflection system is 
synchronized with the main video signal. The main video signal must 
be speeded up, as explained above, to fill the wide screen display. 
The auxiliary video signal must be vertically synchronized with the 
first video signal and the video display. The auxiliary video signal 
can be delayed by a fraction of a field period in a field memory, and 
then expanded in a line memory. Synchronization of the auxiliary 
video data with main video data is accomplished by utilizing the 
video RAM 350 as a field memory and a first in first out (FIFO) line 
memory device 354 for expanding the signal. 

The asynchronous nature of the read and write clocks requires 
that steps be undertaken to avoid read/write pointer collisions. 
Read/write pointer collisions can occur when old data is read out of 
the FIFO before new data has an opportunity to be written into the 
FIFO. Read/write pointer collisions also occur when new data 
overwrites the memory before the old data has an opportunity to be 
read out of the FIFO. The size of the FIFO is related to the minimum 
line storage capacity thought to be reasonably necessary to avoid 
read/write pointer collisions. A field synchronization system for 
avoiding read/write pointer collisions and maintaining interlace 
integrity is explained more fully in connection with FIGURES 12-18. 

The picture-in-picture processor operates in such a manner 
that the auxiliary video data is sampled with a 640fH clock locked to 
the horizontal synchronizing component of the incoming auxiliary 
video signal. This operation enables orthogonally sampled data to be 
stored in the video RAM 350. Data must be read out of the video RAM 
at the same 640fH rate. The data cannot be orthogonally displayed 
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from the v,deo RAM without modification due to the generaliy 
asynchronous nature of the main and auxi.iary video sources In 
order to fad.tate synchronization of the auxi.iary signaT to the 

cTrn- a ,in : memory with independen < ~£ ^ £ 

:TZuiT d ,n ,he auxi,iary si9nai path - o' - 

video RAM P 3 SO C f r ' y, aS Sh ° WR ^ RGURE 12 ' me * *. 

352B The VRAM nnr " * "* °* *"* 4 " bit latenes 352A and 
352B. The VRAM.OUT output is in 4-bit data blocks. The 4-bit 

data u T h , r/r° mbine ,he auxinary s * nai «•* 

354 b t'he 8 ^ Jot c^red^amo! T" ^ «" RF ° 
for storage in the v^rUr^rS %£ZZ£? X ? 
The 8-bit data blocks are read out of the FIFO 354 by^he ^ 
d.splay clock which is .ocked to the horizontal synchronizing 
component of the main video sional Thi« cnramz,n 9 
uses a multinla lino m . ' aSIC con,l 9"ration, which 

! 8m0ry w,th ind 9Pendent read and write port 

and color difference samples by demultiplexer 355 The date 
samples may then be interpolated as necessary for the desired 
format d.splay ratio and written as video data output 

A suftaently large memory must be chosen in the first 
instance ,n order to avoid read/write pointer collision in the 
aux,l,ary channel FIFO. For displaying norma, forma, disp ay ratio 
v,deo cropped by 33%, the auxiliary FIFO, which is 2048 X 8 n s 2e 

wheT N ?s l S n ri " 9 h 1 °' ^ ^ - 

l ; 204 3 Lo 0 -! 2) s .; ,640) ■ 350 based on 82% — - p— 

An aspect of the invention recognizes that precession rates greater 
than 2 „nes/field are no, likely to be encountered. Therefore a 

" °' 3 5 F ' FO '° r ' he auXilia ^ cha ""* ca b/ 
sufficient to prevent read/write pointer collisions. 
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The memory usage of the auxiliary channel FIFO can be mapped 
out as shown in FIGURE 13. A block diagram for a simplified circuit 
formed by D-type flip/flops for generating line delays (Z-1) and 
reset pulses for controlling writing and reading in the FIFO 354 in 
the auxiliary signal path is shown in FIGURE 14. At the beginning of 
a new main signal field, the write pointer is reset to the start of 
the FIFO. This reset pulse, denoted WR_RST_AX is the combination 
of V_SYNC_MN sampled by H_SYNC_AX. In other words, WR_RST_AX 
occurs at the first horizontal synchronizing pulse of the auxiliary 
video signal which occurs after a vertical synchronizing pulse of the 
main signal. Two main signal horizontal lines later the read pointer 
is reset to the start of the FIFO 354. This reset pulse is denoted 
RD_RST_AX. In other words, RD_RST_AX occurs at the third 
horizontal synchronizing pulse of the main video signal which occurs 
after a vertical synchronizing pulse of the main signal, or stated 
still otherwise, at the second horizontal synchronizing pulse of the 
mam signal which occurs after the WR_RST_AX pulse. 

Since the main and auxiliary signals are asynchronous, there is 
some ambiguity about exactly where the write pointer is when the 
read pointer is reset. It is known that the write pointer is leading 
the read pointer by at least two lines. However, if the frequency of 
the auxiliary channel horizontal sync is higher than the frequency of 
the main channel horizontal sync, then the write pointer will have 
advanced past the 2 line marker shown. It is in this way that a 
pointer collision is avoided for all signals with less than 2 
lines/field precession rate. The auxiliary channel FIFO 354 is 
partitioned into 5 line pieces through appropriately timed read and 
write reset signals. In this scheme, the read and write pointers are 
initialized at the beginning of each displayed field at least 2 lines 
apart from each other. 

If the FIFO were not a complete 5 lines long, the system would 
sacrifice the memory distance frcm the write pointer to the read 
pointer. This is the case for different squeeze modes, for example a 
16% squeeze: 

16% squeeze N » (5/6) • (0.82) • 640 - 437 

L - 2048 (5*437) = 4.7 
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in these cases, the FIFO proves to be less than 5 lines long In the 
6% squeeze, the actual FIFO length is 4.7 lines. The (0 I) ^ n 

r«: %?2; f the 33% ~ — - °~ K£ 

of tJiineVof ™? Wi,e r8Se,S ar9 Spaced * a "«""»«»" 

of two lines of active video, the sacrifice always comes at the 

expense of allowing the read pointer to catch up with the write 

pointer. Moreover, only 80% of the video line is considered a «ve 

because the picture-in-picture processor is not capable of storina 

more than 512 video samples in the video RAM 350 In practLe L 

Ml provides a good active video line. In these cases the 

T^Z T ^ b9i " 9 SaCri,iC8d for m ° rS visibie P'«ure content 
In addition, there ,s more distortion in the auxiliary video In the 

worst case, up to one line per field of precession can be tolerated 
between the main and auxiliary video sources. This is m mo re 
than ,s necessary for most video sources, and the precession rate 
tolerance » sacrificed on those feature modes which can be 
expected to be the least used. 

writina An °* e : P ;,° p b ' em S, 1 f mmin 9 *»m the asynchronous reading and 
writing of the FIFO ,s that of maintaining interlace integrity of the 
auxiliary channel video. Since the display is locked to the main 
channel video, the current field type being displayed. *« , ™ 
upper or lower field, wi.l be determined by the main signa.. The 
held type which is stored in the video RAM 350 memory and ready to 
be read out a. the star, of the main channel field may or may no, J 
the same as the displayed field type. I, may be necessary to change 
he auxiliary fie,d type stored in the video RAM 350 to mateh ha, of 
the main channel display. 

The picture-in-picture processor 320 and the gate array 300 
quanfze 262.5 line fields of the NTSC s,gna, into 263 line upper 
fields (sometimes referred to odd fields) and 262 line lower fi eWs 
sometimes called even fields). This is due to fact that vertical 
sync ,s sampled with pulses representing horizontal sync. This is 

! dSo f a9ram °' RGURE 1S - A " "PP-^r '-Id «y e 

ields Th S 3 r J ° f UPPSr " eldS 3 V3lUe 0 tor lower 
fields. The upper fields include odd lines 1 through 263. The lower 
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fields include even lines 2 through 262. In FIGURE 16, the first field 
type indicator U/L MAIN SIGNAL represents the field type of the 
main video channel. The signal HSYNC.AX represents the horizontal 
sync signals for each line of the auxiliary channel. 

The field type indicator U/L(A) represents the field type 
stored in the video ram 350 if each auxiliary channel line were 
written in "normally". The term normal is used here" to indicate that 
the odd lines 1-263 are written in to the video RAM 350 as the upper 
field is being received and decoded. The field type indicator U/L(B) 
represents the field type stored in the video RAM 350 if the first 
line of the upper field is not written into the video RAM 350 during 
the reception of an upper field. Instead, the first line is actually 
tacked onto the last line (number 262) of the lower field. This 
effectively inverts the field type since line 2 will be the first 
displayed line and line 3 will be the second displayed line in the 
frame. The received upper field now becomes the lower field and 
vice-versa. The field type indicator U/L(C) represents the field type 
stored in the video RAM 350 if the last line of the upper field is 
added to the video RAM 350 during the reception of the lower field. 
This effectively inverts the field type, since line 263 will be the 
first displayed line and line 1 will be the second displayed line. 

The addition and subtraction of lines in modes B and C does not 
degrade the auxiliary channel picture because these lines occur 
during vertical retrace or overscan. The order of the displayed lines 
is shown in FIGURE 18, where solid lines represent upper field lines 
and dotted lines represent lower field lines. 

As the main and auxiliary channel signals precess, the U/L 
MAIN SIGNAL will shift to the left or the right with respect to the 
auxiliary channel U/L(A,B,C) field type indicators. In the position 
shown in the diagram, data should be written into the video RAM 350 
using mode A, because the decision edge is in zone A. Mode A is 
appropriate because when the picture-in-picture processor receives 
vertical sync, it will write the same field type into the video RAM 
350 as will be required by the display to read from the video RAM 
350 starting with V_SYNC_MN (main channel vertical sync). As the 
signals precess. the mode will change according to their relative 
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positions. The valid modes are shown graphically at the top of 
FIGURE 16 and in the table of FIGURE 17. There is an overlap 
between modes B and C, since most of the time that mode B is valid 
mode C ,s also valid, and vice-versa. This is true for all but 2 lines' 
out of 262 lines. Either of modes B or C can be utilized when both 
are valid. The choice can be arbitrary, or based on other circuit 
considerations. 
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What is claimed is: 

1. A synchronization system, comprising: 

video display means synchronized with a first video signal 

having a first line rate component and a first field rate component: 
a field memory for a second video signal having a second line 

rate component; 

a multiple line memory having independently resettable write 
and read pointers; 

means operative synchronously with said second line rate 
component for sub-sampling said second video signal, for writing and 
. reading said subsampled video signal into and out of said field 
memory respectively and for writing said subsampled video signal 
into said multiple line memory; 

means operative synchronously with said first line rate 
component for reading said subsampled video signal out of said 
multiple line memory; 

means for resetting said write pointer by sampling said first 
field rate component with said second line rate component; and, 

means for resetting said read pointer by sampling said first 
field rate component with said first line rate component. 

2. The system of claim 1, wherein said write pointer is reset 
up to one line period of said second video signal after every start of 
field of said first video signal. 

3. The system of claim 1, wherein said read pointer is reset at 
least two line periods of said first video signal after every start of 
field of said first video signal. 

4. The system of claim 1, wherein said read pointer is reset at 
least two but not more than three line periods of said first video 
signal after every start of field of said first video signal. 

5. The system of claim 1, wherein each of said means for 
resetting said write and read pointers comprises respective delay 
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means for resetting said write pointer up to one line period of said 
second v,deo signal after every start of field of said first video 
signal and for resetting said read pointer at ,eas. J L periods 

vider si s. video si9nai after every stan oi fieid " - " 

r«»ttl SySt9m °' °' aim 1 ' Wherei " each of «id -means for 
resettng sa,d wnte and read pointers comprises respective delay 
means for resetting said write pointer up , 0 one line period of slid 
second v,deo signal after every star, of field of said firs, video 

H 3 , reSetti " 9 Sald reM POinter at leas * *w but no, more 
than three „ne periods of said first video signal after every star, of 
field of said first video signal. 

said L e 7 Tj yS T ° 1 C ' aim 1 ' Wher8in Said means for netting 
said write and read pomters comprise respective delay means for 

avo,d,ng read/wnte pointer collisions for all signals having a 

precession rate of no, more man two lines per field. 

8. The system of claim 5, wherein said respective delav means 

sTotl^ Wite P ° imer UP t0 °" e " ne Peri0d ° f said -cond ide 

said read pointer at leas, two line periods o, said first video signal 
after every start of field of said first video signal. 

9 - Th e system of claim 5, wherein said respective delay means 
reset said wnte pointer up to one line period o, said second video 
signal after every start of field of said first video signal and reset 
said read center at least two but not more ,han three line periods 
of said firs, video signal after every start of field of said first 
video signal. 

10. The system of claim 1. comprising delay means for 
avoiding read/write pointer collisions. 
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11. The system of claim 10, wherein said delay means 
comprises: 

a first single stage D-type latching means in which said first 
field rate component is clocked as an output by said first line rate 
component; 

a second single stage D-type latching means in which said 
output of said first single stage D-type latching means is clocked as 
a write reset signal by said second line rate component; and, 

a two stage D-type latching means in which said output of said 
first single stage D-type latching means is clocked through said two 
stage D-type latching means as a read reset signal by said first line 
. rate component. 

12. A synchronization system, comprising: 

video display means synchronized with a first video signal 
having first horizontal and vertical synchronizing components; 

a multiple line memory for a second video signal having a 
second horizontal synchronizing component, said multiple line 
memory having asynchronous write and read ports and independently 
resettable write and read pointers; 

means for generating a write clock signal synchronously with 
said second horizontal synchronizing component for writing said 
second video signal into said multiple line memory; 

means for generating a read clock signal synchronously with 
said first horizontal synchronizing component for reading said 
second video signal out of said multiple line memory; 

means for resetting said write pointer at the first end of a 
line period of said second video signal after every start of field of 
said first video signal; and, 

means for resetting said read pointer at the second end of a 
line period of said first video signal after said resetting of said 
write pointer. 

13. The system of claim 12, further comprising a field 
memory for storing said second video signal prior to said writing of 
said signal into said multiple line memory. 



WO 91/19379 



- O Q - 



PCT/US9 1/03745 



14 The system of claim 13, wherein said field memory has 
write and read ports clocked synchronously with said second 
horizontal synchronizing component. 

15. The system of claim 13, further comprising means for 
subsampling said second video signal synchronously with said 
second horizontal synchronizing component prior to being stored in 
said field memory. 
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